UNCLASSIFIED  F/C  12/3 


1/1 

1C 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  t  lermti) 


REPORT  DOCUMENTATION  PAGE 

READ  INSTRUCTIONS 

BEFORE  COMPLETING  FORM 

t.  REPORT  NUMBER  2.  GOVT  ACCESSION  NO. 

a  r  icn-of  l  r-OM  0  ^ 

3.  RECIPIENT’S  CATALOG  NUMBER 

4.  TITLE  (And  Submit) 

Technical  Memo  9,  "Algorithms  and 

Intuition. " 

5.  TYPE  OF  REPORT  6  PERIOD  COVERED 

6.  PERFORMING  ORG.  REPORT  NUMBER 

D-4297 

7.  AUtHORf*; 

Mathematical  Analysis  Research  Corp. 

8.  CONTRACT  OR  GRANT  NUMBERfij 

9.  PERFORMING  ORGANIZATION  NAME  ANO  ADDRESS 

Jet  Propulsion  Laboratory  ATTN:  171-209 

California  Institute  of  Technology 

4800  Oak  Grove,  Pasadena,  CA  91109 

10.  PROGRAM  ELEMENT.  PROJECT,  TASK 
AREA  &  WORK  UNIT  NUMBERS 

RE  182  AMEND  #18p 

II.  CONTROLLING  OFFICE  NAME  ANO  AODRESS 

Commander,  USAICS 

ATTN:  ATSI-CD-SF 

Ft.  Huachuca,  AZ  85613-7000 

12.  REPORT  DATE 

17  Apr  87 

13.  number  of  pages 

13 

14.  MONITORING  AGENCY  NAME  A  AOORESSflf  dlllerent  from  Controlling  0111  co) 

Commander,  USAICS 

ATTN:  ATSI-CD-SF 

Ft.  Huachuca,  AZ  85613-7000 

15.  SECURITY  CLASS,  (ot  Ihlm  report) 

UNCLASSIFIED 

IS..  OECLASSI  FI  CATION/ DOWN  GRADING 
SCHE« 

16.  DISTRIBUTION  STATEMENT  (at  thia  Report) 

Approved  for  Public  Dissemination 

17.  DISTRIBUTION  STATEMENT  (ot  the  ebatrect  entered  In  Block  20,  It  different  from  Report) 

Prepared  by  Jet  Propulsion  Laboratory  for  the  US  Army  Intelligence  Center  and 
School's  Combat  Developer's  Support  Facility. 

!•.  SUPPLEMENTARY  NOTES 

19.  KEY  WOROS  (Continue  on  revoteo  aide  li  nec eatery  and  identify  by  block  number) 

Graphics,  Simulation,  Ellipse  Combination,  Fix  Algorithms,  Bias 

20.  ABSTRACT  (Continue  era  rarer  me  ai+  ft  nnceeeery  and  identity  by  block  numb*.*) 

-This  report  describes  the  fix  simulation  program  available  at  Mathematical 
Analysis  Research  Corp.  (MARC,  4329  Via  Padova,  Claremont,  CA  91711). 

This  program  simulates  lines-of-bearing  (LOB's)  between  sensors  and  emitters, 
subsequent  fix  estimation  (with  several  fix  algorithms  available),  and  EEP 
ellipse  generation.  Results  are  displayed  on  a  terminal  screen  and  can  be 
obtained  in  hard  copy  on  a  graphics  plotter,  finally,  the  report  describes 
bias  results  for  all  of  the  available  fix  algorithms.  < 

00  i  jan^7)  U73  EDITION  OF  »  MOV  «S  IS  OBSOLETE 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  fWh.n  D.t.  Entered) 


U.S.  ARMY  INTELLIGENCE  CENTER  AND  SCHOOL 
Software  Analysis  and  Management  System 


Algorithms  and  Intuition 


EAAF 


Technical  Memorandum  No.  9 


17  April  1987 


Author: 


Mathematical  Analysis^esearch  Corporation 


Approval : 


mes  w:  Gillis,  Subgroup  Leader 
Algorithm  Analysis  Subgroup 


Concv 


A . *  F :  E liman ,  Manager 
Ground  Data  Systems  Section 

Fred  Vote,  Manager 
Advanced  Tactical  Systems 


Edward  J.  Records,  Supervisor 
USAMS  Task 


l  A*:ct'Siou  tor 


fas  C'RA&i 


one  TAB 


i  LJfJiir  (j  r  I 


.  r  py 
V:r>.CTEO 


Av  -(ity  CoOv-‘ 


.  .•VI  -  .  ;d  /  cf 


id;/; 


JET  PROPULSION  LABORATORY 
California  Institute  of  Technology 
Pasadena,  California 


PREFACE 


The  work  described  in  this  publication  was  sponsored 
by  the  United  States  Army  Intelligence  Center  and  School. 
The  writing  and  publication  of  this  paper  was  supported 
by  the  Jet  Propulsion  Laboratory,  California  Institute 
of  Technology,  under  a  contract  with  the  National 
Aeronautics  and  Space  Administration,  NAS  7-918,  RE  182, 
A187. 


EXECUTIVE  SUMMARY 


This  Technical  Memorandum  was  prepared  to 
satisfy  the  often  asked  question  by  customer 
personnel  in  the  field  "  what  are  algorithms  and 
how  do  they  apply  to  my  work?  " .  This  report  was 
requested  verably  by  the  Combat  Developers  Support 
Facility  personnel  during  FY-86  and  used  FY-86 
funds. 

The  work  in  this  tutorial  memo  is  supported  by 
a  simulation  system  which  runs  on  the  IBM  PC-  series 
of  computers.  This  combination  can  be  useful  for 
training  new  analysts. 
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Also-ithms  and  Intuition 
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..gurithms  have  idiosyncrasies  and  behavior  pattern;.  Stacy  can  r=v’-.l 
*■  r,r phenomena.  In  emitter  detection,  location  and  identification, 
r,  a  c:t  of  algorithms  are  intertwined  into  a  system.  Re  duo  tier.  c‘" 
pat  tarns  individual  algorithms  to  mathematical  expressions  dues 
rios^arily  resolve  the  problem  cf  interpreting  these  results  in  terms  c 
b-V. « .  io" .  There  are  two  rolioies  that  MARC  follows  to  made  results 
•citnant  to  analysis  of  system  behavior: 

)  fiu.iy  c:.nV  ir.tic.ns  of  algorithms  and  algorithm  interfaces 
•)  Reduce  algorithm  behavior  to  an  intuitive  format  (geometric  if 
possible)  sc  that  qualitative  analysis  may  be  used  to  expand 
algorithm:'”  insights  into  systematic  insights. 

..r-tionship  between  basing  ellipses  on  the  F  test  ar.d  using  a  Chi-squar 
c-tmbir, abler.  algorithm  is  an  example  where  MARC  has  followed  (')  ab:v 
the  objective  cf  this  memo,  however,  to  illustrate  one  of  MAF.Cs  too.s 
'suit  or  (2)  above.  In  particular  MARC  uses  a  graphical  LIT  simulator 
a. lews  overlay  of  algorithm  results  including  competing  algorithms. 

Section  I  below  the  current  version  of  the  program  is  discussed 
.y.  in  Section  2  tr.e  use  cf  the  LOB  simulator  program  is  deraor.st rated 
•.r  types  cf  screens  and  reports  available.  Ir.  Section  5  there  is 

:sitr,  cf  algorithms  which  provides  seme  cf  the  basic  materials  uced  to 
:n  intuition  regarding  differences  and  similarities  in  Fix  behavior.  I 
ir.  -  a  nummary  of  oias  results  (which  wiil  ce  reperted  more  completely 
:r  re:.' ert)  is  used  to  illustrate  an  example  of  the  results  cf  a  mix  of 
.  1 1 1 i  '.n  • 


;,c-;  a:;p  fix  simulator  prciram 

Tr.c  main  menu  of  this  program  Is  shown  in  figure  1.  Tha  options  and 
capabilities  of  each  menu  option  are  discussed  below.  Note  that  current 
capabilities  are  specified  although  MARC  frequently  modifies  the  program  for 
~ pec i il  applications. 

A .  1.00  -  -  °  S  on  ? or  s 

Ir.is  option  allows  or.e  tc  specify  up  to  ’0  locations  LOBs  will  be  ta»:ar. 
from,  ("ore  than  '0  locations  may  be  specified  with  certain  limitations  whe 
c.-ipse  combination  is  being  used.  See  options  I  and  J.  The  limit  cf  10  is 
often  changed  depending  on  the  application  and  competing  memory  requirements 
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B.  Locate  the  Emitter 


Only  one  emitter  may  be  currently  specified  although  MARC  intends  to 
create  a  modification  of  this  program  that  allows  multiple  emitters  fcr  study 
of  wild  bearings  and  tests  fcr  combination  of  data. 

C.  Specify  Sensor  Accuracy 

This  option  allows  specification  of  different  standard  deviations  for  the 
ancui sr  accuracy  of  individual  LOEs.  It  also  allows  specification  of  a 
standard  deviation  for  location  error  although  it  is  only  implemented  for  the 
study  of  one  Fix  algorithm.  Recent  information  communicated  to  MARC  has  also 
suggested  that  a  different  model  may  be  appropriate  for  location  error. 

E.  Change  Fix  Algorithm 


This  option  allows  the  fix  algorithm  to  be 

1)  none  (LC3s  can  be  shewn  without  fixes,  etc..  This  option  ha3  been 

useful  for  production  of  graphs  for  reports.) 

2)  Perpendicular 

3^  Weighted  Perpendicular 
*0  Angular  Error  Minimization 

5)  Weighted  Perpendicular  with  location  error 

6)  F  test  based  weighted  perpendicular  (the  other  versions  use 

knowledge  of  the  true  accuracy  and  a  Chi-Square 
distribution) 

At  the  time  this  option  is  chosen  if  an  LOB  graph  is  on  the  screen  fixes  and 
ellipses  corresponding  to  the  new  method  are  added  to  the  screen  except  in  the 
case  of  option  5)  above  where  it  would  confuse  the  graph. 

E.  Graph  LOBs 


Random  errors  are  generated  for  each  LOB  ar.c  the  results  are  plotted 
together  with  a  fix  and  ellipse  if  appropriate  to  the  Fix  Algorithm  active. 

Tr.e  user  is  then  given  the  option  of  sending  the  results  seen  on  the  screen  to 
a  plotter. 

F.  Simulate  Fixes 


Similar  to  E  above  but  only  fixes  are  plotted  and  up  to  5000  runs  may  be 
specified.  Examples  of  the  results  of  simulation  may  be  found  in  Figures  2 
and  3.  Statistics  for  the  simulation  are  also  shown. 

G.  Change  Save  Fix  Mode 

When  this  is  turned  on  all  subsequent  ellipses  generated  are  combined 
using  the  standard  ellipse  combination  method.  This  approach  has  greater 
flexibility  than  the  pattern  method  described  below  under  I  and  J. 

H.  Combine  Saved  Fixes 


Actually  the  combination  is  done  already  and  this  option  merely  shews  the 
result.  To  the  User  this  title  seemed  appropriate,  however. 
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Figure  3 


I.  Sgt  Multiple  Fix  Pattern 


-o- 


Copy  -- 
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-  action' 

4> 

This  is  used  to  design  a  simulation  of  generation  and  combination  of 
ellipses  according  to  the  pattern  specified. 

J.  Combine  According  To  Pattern 


This  option  is  redundant  as  it  is  the  case  of  1  simulation  according  to 
fee  pattern  defined  in  I.  Future  versions  of  this  program  may  combine  this 
option  with  option  K. 

K.  Simulate  Combinations 


This  option  simulates  combinations  according  to  a  specified  pattern. 

L.  Graph  Scaling: 


Allows  some  rescaling  when  the  program  logic  does  not  yield  the  scale 
desired. 


Ill.  2-PI.VPN3 ION.AL  FIX  ALGORITHMS 

For  the  purposes  of  this  section  we  will  assume  the  only  source  of 
i-.cccu  "aoy  is  error  in  the  direction  of  the  bearing. 

It  is  the  intention  of  this  section  to  discuss  similarities  ar.d 
differences  in  the  concept  of  various  algorithms.  Actual  differences  may  be 
s-.  ?n  in  the  differences  ir.  the  location  estimates  they  produce.  See  Figure  4. 

2- Di~ ionai  Least  Sauares  Fix  Algorithms 


Least  Squares  Algorithms  are  algorithms  that  estimate  parameters  by 
-.i-iring  a  sum  of  squared  terms  (usually  a  measure  of  error)  where  each  term 
depends  only  or.  the  parameters  and  one  observation.  For  our  application  the 
;  uraneters  are  the  x  ar.d  y  coordinates  cf  the  location  estimate  and  the 
..Lservaticns  are  LOBs. 

All  but  one  of  tne  algorithms  to  be  discussed  can  be  characterized  by 
ic'  =  t  squares.  This  is  not  the  reason  for  the  importance  of  the  least  squares 
characterizations,  however.  For  example,  all  of  the  algorithms  discussed 
could  be  characterized  in  defining  equations  for  implicit  functions  yet  this 
gives  r.o  insight.  The  least  squares  characterizations  are  important  because: 

(1)  They  allow  one  to  analyze  behavior  intuitively  without  reference  to 
mathematical  details  if  necessary. 

(2)  Least  squares  is  naturally  related  to  the  normal  distribution  and  the 
level  curves  associated  with  it.  It  is  these  level  curves  that  EE?s 
approximate. 


Examples  of  Least  Squares  Algorithms: 


Perpendicular 

Method: 

(The  term  squared  is  the  perpendicular  distance  from 
the  estimate  to  the  LOB.) 

*  I  n  t.  orrnsd  i  2 1 6 

Method’ : 

(The  term  squared  is  the  perpendicular  distance  from 
the  estimate  to  the  LOB  divided  by  the  distance  fro< 
the  sensor  to  the  location  estimate.  Variations 
involve  adjusting  fer  ether  terms  known  to  affect 
location  accuracy  such  as  sensor  accuracy.) 
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Figure  4 
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Angular  Minimization  Method:  (The  term  squared  is  the  angle  between  the  LIT 

and  a  line  from  the  sensor  to  the  location  estimate.) 

An  Algorithm  Not  Definable  In  Terms  Of  Least  Squares 

Weighted  Perpendicular  Method:  (This  is  the  algorithm  which  seems  to 

correspond  most  closely  with  what  MAP.C  has  beer, 
exposed  to  in  operational  algorithms.  It  is  a 
variation  on  the  perpendicular  method  which  introduces 
the  same  weights  as  the  'intermediate  method'  but 
using  a  different  characterization  of  the 
perpendicular  method.  Although  this  method  is  not 
based  on  least  squares  its  similarity  to  methods  that 
are  is  a  useful  tool  in  understanding  it.) 

Sasic  Definitions  (for  the  Least  Square  Methods  Only): 

(X,Y)  =  true  location  of  the  emitter 

=  true  bearing  from  the  kth  sensor  to  the  emitter  (X,Y) 

©k  »  observed  bearing  from  the  kth  sensor  (multiple  readings 
are  treated  as  coming  from  different  sensors) 

(x,y)  -  (x(0.,...,e  ),y(9., — ,6  ))=estimated  location  of  the 
1  n  n  emitter 

a k  =  ak(x,y ,ek)=the  'squared  error  term’  corresponding  to 

the  kth  LOB  and  a  location  estimate  of  (x,y) 
for  the  least  square  method. 

S(x,y,e.  , . . . ,  e  )  =  i^ak  =  the  sum  of  squares  that  the  method  minimizes 

ok  *  standard  deviation  of  the  angular  measurement  of  the 
kth  L03  in  radians  (multiply  by  tt/180  if  in  degrees) 


Perce.ndi  cular  Method 


ak  =  (x"^k) Jcos38K+(y-nk) 2sin29K-2(x-ck) (y~nk) 

Angular  Minimization  Method 


ak  -  [Arctan((x-£k)/(y-nk))-0k] 
'The  Intermediate  Method' 


[(x-£  )  2cos20  +(y-n 2sin29  -2(x-£  )  ( y- n.  )  ]/[  (x- 


2+(y-hk) 2] 


The  'Intermediate  Method'  is  so  close  to  the  Angular  Minimization  Method 
that  the  title  invented  here  is  not  really  needed.  (The  relationship  is 
easily  shown  using  Taylor  Series  expansions.)  It  was  included  here  because  it 
makes  the  relationship  between  the  Perpendicular  Method  and  the  Angular 
Minimization  Method  clearer  and  because  it  shows  that  the  Angular  Minimization 
Method  is  a  type  of  'weighted'  Perpendicular .  The  method  referred  to  in  this 
method  as  the  Weighted  Perpendicular  uses  the  same  weights  but  at  a  different 
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V.  BIAS 


The  objective  of  this  section  i_  a  specific  pattern  to  differences 
between  particular  methods.  In  this  case  the  differences  are  differences  in 
bias  behavior  of  the  Perpendicular  Method  and  the  Angular  Minimization  Method. 

Formula  (and  notation)  for  Bias  in  the  General  Least  Squares  Case 


Let  subscripts  on  a,  x  or  y  which  follow  a  comma  denote  partial 
derivatives.  For  example  an  'x'  subscript  denotes  the  partial  with  respect  to 
x  or  an  i  subscript  denotes  the  partial  with  respect  to  0  .  Furthermore,  let 
X,Y  with  a  comma  and  subscript  indicate  the  corresponding  x  or  y  term 
evaluated  at  the  true  location  and  the  variables  below  denote  the  indicated 
term  EVALUATED  at  the  true  LOBs.  (Recall  that  Taylor  Series  uses  evaluated 
deni vati ves. ) 


bk=ak, x 

dk=ak,xx 

g. 

k  k,xxx 


Vak,y 


bk”ak,kx  ^k*ak,ky 


bk  ’ak,kx  ^k  ”ak,ky 


e,  -a,  f,  -a,  d,  -a,  ,  e,  -a,  ,  f,  -a,  . 

k  k.xy  k  k,yy  k  k,kxx  k  k,kxy  k  k.kyy 

h,  “a,  i,  -a,  j,  -a. 

k  k,xxy  k  k.xyy  k  k,yyy 


Computing  a  Taylor  Series  for  location  error  in  terms  angular  error  by  using 
implicit  derivatives,  taking  the  first  order  term  in  the  series  and  computing 
its  expected  value  yields 

n  n 

U, 

FIRST  ORDER  BIAS«(-1/Q)  *  C" 


.  I^f. 
k  *1  k 

-I1?8. 
k-1  k 


k’l6k]  *  r"  fk  ]  o * 

rn  k-1  „  k 

k-1  k  k 


* « 


c-LsX)!k£?fk)-(K5?^>' 

a'--  «,  •  (>:.k)Ir,£?V-’x.kl.k 

ar.i  V,  „  (X  ,  )J  r;r.  .2X  ,  X  ,,  *(Y  ,  )’  E?j  *2X  lre'*2't 

k  , k  m-1  n  , k  ,k  m-1  k  ,k  m-1  n  ,kk  ,kk  k 

Implicit  function  theory  also  must  be  used  to  determine  X  and  Y 


y  i  e 1 ds 
X 
Y 


.k 


.k' 


It 


» k 


E?f 
i-l  m 

"m£lem 

rc-1  m 

m£?dm 

]  »  l  ;] 

c, 


[  3  -  (-1/Q)  *  [‘ 

,k  rcSi~m  m5l”m  ~k 

Perpendicular  Method  versus  Angular  Minimization  Method 

To  a  first  order  approximation  the  biases  turn  out  to  be  identical, 


Large  numbers  of  LOBs 


Terms  that  have  more  sums  in  the  denominator  than  in  the  numerator  go  to 
zero  (unless  the  terms  in  a  sum  in  the  denominator  collapse  which  doe3  not 
occur  in  our  application.)  As  the  number  of  LOBs  becomes  large  our  first 
order  bias  term  approaches  the  remaining  terms,  namely 


FIRST  ORDER  BIAS»(-1/Q)  *  [ 


£nf 

k-r  k 

-  Ene 

kilek 


-  £ne 
k=1ek. 

k-»dk 


k-1  •• 

Ck 


]  os 


For  angular  minimization  and  the  weighted  perpendicular  method  this  turns  out 
to  be  equal  to  zero.  Thus  as  the  number  of  LCBs  increases  tne  bias  goes  to 
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for  these  two  methods.  For  the  perpendicular  method  this  does  not 
(•'..-.'pen.  In  this  case 

bk’-  X“^k  c"'  Y"nk 

Symmetric  Case 


Many  bias  effects  are  of  different  signs  and  hence  cancel.  By  restricting 
attention  to  a  symmetric  case  it  is  possible  to  show  the  behavior  of  terms 
1 — s s  prone  to  cancellation.  In  particular,  the  formulation  given  here  is  for 
an  emitter  on  the  y-axis  and  such  that  for  every  LOB  taken  from  a  sensor  on 
^.',e  side  of  the  y-axis  there  is  another  LOB  (from  an  equally  accurate  sensor) 
directly  across  the  y-axis  (i.e.  (£.n)  and  (£,-n)). 

According  to  the  predicted  result  for  symmetric  bias  in  the  Perpendicular 
Method,  bias  changed  from  long  to  short  as  the  number  of  LOBs  increased.  In  a 
symmetric  situation,  bias  in  the  x-direction  is  predicted  to  be  zero,  so  bias 
is  entirely  in  the  y-directicn.  In  Figures  2  and  3,  only  five-hundred 
simulations  were  used  to  generate  the  plotted  illustrations  in  order  to 
achieve  a  clear  diagram,  although  more  simulations  would  generate  results 
closer  to  the  predicted  results.  Figure  3  is  identical  to  Figure  2  except 
Luat  there  are  5  sensors  at  each  location  instead  of  only  two.  Note  the 
marked  change  in  YBAR  between  the  two  diagrams;  even  five-hundred  simulations 
showed  the  change  of  direction  in  bias  as  the  number  of  LOBs  increased  from  2 
to  1C. 
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